Alternating minimization and Boltzmann machine learning
نویسندگان
چکیده
منابع مشابه
Alternating minimization and Boltzmann machine learning
Training a Boltzmann machine with hidden units is appropriately treated in information geometry using the information divergence and the technique of alternating minimization. The resulting algorithm is shown to be closely related to gradient descent Boltzmann machine learning rules, and the close relationship of both to the EM algorithm is described. An iterative proportional fitting procedure...
متن کاملL1-regularized Boltzmann machine learning using majorizer minimization
We propose an inference method to estimate sparse interactions and biases according to Boltzmann machine learning. The basis of this method is L1 regularization, which is often used in compressed sensing, a technique for reconstructing sparse input signals from undersampled outputs. L1 regularization impedes the simple application of the gradient method, which optimizes the cost function that l...
متن کاملInductive Principles for Restricted Boltzmann Machine Learning
Recent research has seen the proposal of several new inductive principles designed specifically to avoid the problems associated with maximum likelihood learning in models with intractable partition functions. In this paper, we study learning methods for binary restricted Boltzmann machines (RBMs) based on ratio matching and generalized score matching. We compare these new RBM learning methods ...
متن کاملLearning Criticality in an Embodied Boltzmann Machine
Many biological and cognitive systems do not operate deep into one or other regime of activity. Instead, they exploit critical surfaces poised at transitions in their parameter space. The pervasiveness of criticality in natural systems suggests that there may be general principles inducing this behaviour. However, there is a lack of conceptual models explaining how embodied agents propel themse...
متن کاملBoltzmann Machine for Population-Based Incremental Learning
Abstract. We propose to apply the Boltzmann machine (BM) to population-based incremental learning (PBIL). We will replace the statistical model used in PBIL, which assumes that the binary variables of the optimisation problem are independent, with that of a BM. From the logarithm of the expectation of the function to maximise, we derive specific learning rules for the BM. These learning rules i...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Neural Networks
سال: 1992
ISSN: 1045-9227
DOI: 10.1109/72.143375